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FERRIS-WHEEL QUEUE 
Background Of The Invention 

1 . Field of the Invention 

This invention generally relates to a message processing system in a data 
5 system environment and, in particular, to a point-to-point data messaging system 
including a data queuing method. 

2. Description of Related Art 

Data messaging systems between computers and computer networks typically 
infer the use of multiple queues to support their required data buffering. Further, 
10 some methods used in balanced queue communication systems between nodes in a 
distributed computing environment have been disclosed as also using multiple queuing 
configurations. Multiple queues tend to use a substantial amount of system overhead, 
especially in the amount of memory usage for both redundant queue support code, as 
well as, buffer space. 

15 The prior art discloses methods directed towards how the data of a single 

process is distributed and received on a multipoint-to-point network system where 
other nodes may also transmit data onto the network. However, these references do 
not disclose data being generated by multiple processes operating on a single node. 
Further, the prior art references do not disclose a method for ensuring that the data 

20 generated internally by multiple processes, is uncorrupted before being transmitted 
onto the network. Typical multipoint-to-point networks enable messaging, however, 
they are deficient in ensuring or reducing the likelihood of multi-processes corrupting 
data within any single node prior to that data being sent onto the network. 

Other prior art references are substantially directed towards various rates of 

25 data sources on asynchronous networks (ATM), and how the data cells may be 
transmitted and reliably reassembled by the receivers, yet do not disclose the 
possibility of data corruption of the data prior to or during the development of the 
data cells, as a result of multiple processes. 
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Further, typical prior art references do not disclose a method of reconfiguring 
distributed queue systems. As requirements change, reconfiguring the size and 
functionality of a queue may optimize the system. If a distributed queue system is 
part of a balanced queue system, then every node in the network must be reconfigured 
5 each time any node requires a larger database. In general, every node is effected by 
changes in any other node in a distributed queue system. If a system is not properly 
optimized by reconfiguration, then system resources may be wasted. 

Bearing in mind the problems and deficiencies of the prior art, it is therefore 
an object of the present invention to provide a messaging systems which uses a single 
10 queue. 

It is another object of the present invention to provide a queue that will solve 
the problem of storing internally generated data from multiple internal sources. 

It is yet another object of the present invention to provide a method for data to 
be generated by multiple processes while operating on a single node. 
15 it is still another object of the present invention to provide data transmission 

onto a data link independent of transfer rate and mode. 

It is a further object of the present invention to provide a messaging system 
which is fully configurable to optimize memory usage. 

It is another object of the invention to provide a messaging system that will 
20 transmit data onto a single data link while substantially ensuring non-corruption of the 
transmitted data. 

It is yet another object of the present invention to provide a methods to ensure 
that internally generated data is not being corrupted before being transmitted onto the 
network. 

25 It is still another object of the present invention to provide a readily 

configurable queue for optimal buffer memory space usage. 

Still other objects and advantages of the invention will in part be obvious and 
will in part be apparent from the specification. 
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Summary of the Invention 

The above and other objects and advantages, which will be apparent to one of 
skill in the art, are achieved in the present invention which is directed to, in a first 
5 aspect, a method of transferring incoming multithreaded concurrent sets of data from 
a sending transport system to a requesting transport system which includes retrieving 
the sets of data, querying a receiving queue for available data storage locations, and 
transferring the sets of data to a receiving queue. The method then includes queuing 
the sets of data in the receiving queue by dividing the sets of data into blocks of data, 

10 storing the blocks of data in the available data storage locations, and having associated 
data by using location indexes to associate the blocks of data with the corresponding 
storage location. The method next includes sending the sets of data by transmitting 
the associated data in the storage locations to the requesting transport system, and 
indicating the storage location is available for storing other the blocks of data. 

15 In a related aspect, the present invention provides transmitting the data in a 

point to point transmission. 

In another related aspect, the present invention provides transmitting data 

synchronously. 

In yet another related aspect, the present invention provides transmitting data 

20 asynchronously . 

In another aspect, the present invention provides a method of transferring 
incoming multithreaded concurrent sets of data from a sending transport system to a 
requesting transport system which includes retrieving the sets of data from the sending 
transport system, a receiving queue being queried for a number of available data 

25 storage locations, and the sets of data being transferred to the receiving queue. The 
method further includes queuing the sets of data in the receiving queue, each the set 
of data being divided into blocks of data, determining a number of the data storage 
locations for storing the blocks of data, the blocks of data being loaded into available 
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the data storage locations, and providing location indexes for each of the blocks of 
data where the location indexes associate the block of data with a corresponding the 
storage location. The method then includes sending the sets of data to the requesting 
transport system by transmitting associated data in the storage locations, and 
5 indicating the storage location is available for storing other the blocks of data. 

In a related aspect, the present invention provides data being transmitted which is sent 
as a single message. 

In a related aspect, the present invention provides data being transmitted as a 
point to point transmission. 
10 In yet another related aspect, the present invention provides data being transmitted 
synchronously. 

In another related aspect, the present invention provides data being transmitted 
asynchronously. 

In still another related aspect, the present invention provides the steps of 
15 calculating a required number of the data storage locations for the sets of data. 

In another related aspect, the present invention provides the steps of 
determining if the receiving queue has available the required number of the data 
storage locations; and signaling the retrieving process to transfer the sets of data to 
the receiving queue. 

20 In yet another related aspect, the present invention provides indicating to the 

requesting transport system that the sets of data are ready for sending. 

In still another aspect, the present invention provides a method of transferring 
incoming multithreaded concurrent sets of data in a point-to-point either synchronous 
or asynchronous transmission from a sending transport system to a requesting 

25 transport system providing a retrieving process for retrieving the sets of data from the 
sending transport system and retrieving the sets of data from the sending transport 
system. The method further calculating a required number of the data storage 
locations for the sets of data. Then, the receiving queue being queried for a number 
of available data storage locations, and determining if a receiving queue has available 
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the required number of data storage locations. Next, signaling the retrieving process 
to transfer the sets of data to the receiving queue and the sets of data being transferred 
to a receiving queue. The method then includes queuing the sets of data in the 
receiving queue, where each the set of data being divided into blocks of data, 
5 determining a number of the data storage locations for storing the blocks of data, the 
blocks of data being loaded into the available data storage locations. The method 
includes providing location indexes for each of the blocks of data where the location 
indexes associate the block of data with a corresponding the storage location. Then, 
providing a sending process for sending the sets of data to the requesting transport 

10 system and indicating to the requesting transport system that the sets of data are ready 
for sending. The method then includes transmitting associated data in the storage 
locations wherein the data being transmitted is sent as a single message, and 
indicating the storage location is available for storing new the blocks of data. 

In still another aspect, the present invention provides a computer program 

15 product for transferring incoming multithreaded concurrent sets of data from a 
sending transport system to a requesting transport system. The computer program 
includes computer readable program code means for retrieving the sets of data, and 
querying a receiving queue for available data storage locations by transferring the sets 
of data to a receiving queue. The program includes computer readable program code 

20 means for queuing the sets of data in the receiving queue by dividing the sets of data 
into blocks of data, storing the blocks of data in the available data storage locations, 
having associated data by using location indexes to associate the blocks of data with 
the corresponding storage location. The computer program further includes computer 
readable program code means for sending the sets of data by transmitting the 

25 associated data in the storage locations to the requesting transport system, and 
indicating the storage location is available for storing other the blocks of data. 

In another aspect, the present invention provides a program storage device 
readable by a machine, tangibly embodying a program of instructions executable by 
the machine to perform method steps for transferring incoming multithreaded 



FIS920000168US1 



5 



m 



m 



concurrent sets of data from a sending transport system to a requesting transport 
system. The program storage device includes retrieving the sets of data, and querying 
a receiving queue for available data storage locations by transferring the sets of data 
to a receiving queue. The device includes queuing the sets of data in the receiving 
5 queue by dividing the sets of data into blocks of data, storing the blocks of data in the 
available data storage locations, having associated data by using location indexes to 
associate the blocks of data with the corresponding storage location. The device 
further includes sending the sets of data by transmitting the associated data in the 
storage locations to the requesting transport system, and indicating the storage location 
10 is available for storing other the blocks of data. 

Brief Description of the Drawings 

The features of the invention believed to be novel and the elements 
characteristic of the invention are set forth with particularity in the appended claims. 
The figures are for illustration purposes only and are not drawn to scale. The 
15 invention itself, however, both as to organization and method of operation, may best 
be understood by reference to the detailed description which follows taken in 
conjunction with the accompanying drawings in which: 

Fig. 1 is a flow chart depicting the method steps of a preferred embodiment of 
the present invention. 

20 Fig. 2 is a flow chart depicting the method steps of the enque process of the 

preferred embodiment of the present invention shown in Fig. 1. 

Fig. 3 is a flow chart depicting the method steps of the deque process of the 
preferred embodiment of the present invention shown in Fig. 1. 

Fig. 4 is a schematic of a computer for running a computer program 
25 embodying the method of the present invention. 
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Description of the Preferred Embodiment(s) 

In describing the preferred embodiment of the present invention, reference will 
be made herein to Figs. 1-3 of the drawings in which like numerals refer to like 
features of the invention. Features of the invention are not necessarily shown to scale 
5 in the drawings. 

The present invention as discloses herein has advantages over previous 
methods disclosed in the prior art and discussed above. The preferred embodiment of 
the present invention substantially ensures that data sent from several internal 
processes remains uncorrupted prior to being sent onto the network. After the data is 
10 sent onto a point-to-point network as described in the present invention, the data 
preferably remains uncorrupted since the receiving node is the other point in the 
network. 

A preferred embodiment of the present invention disclosed herein, solves the 
problems and shortcomings described above, using a "Ferris- Wheel Queue" disclosed 

15 herein. The "Ferris-Wheel Queue" is an abstract data structure which solves the 
problem of storing internally generated data from various internal sources, and also 
solves the problem of transmitting data onto a single data link as an uncorrupted 
group of data. Further, the "Ferris-Wheel Queue" data structure solution may use 
either synchronous or asynchronous communication between data links while 

20 providing a single queue solution for transmitting data from multiple data sources. 

The present invention discloses a single queue approach for receiving multi- 
threaded concurrent sets of data. The advantage of using the single queue method 
disclosed in the present invention includes the elimination of multiple queues, while 
concurrently buffering data from multiple processes. Also, the Ferris-Wheel queue 

25 embodiment of the present invention ensures that concurrent processes on the 
transmitting node do not corrupt the data which is being sent on a point-to-point 
network, where the need for multiple queues has been eliminated. Moreover, the 
present invention provides protection of the integrity of the data from multiple 
concurrent processes within a single queue solution. Another advantage of the present 
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invention is the scalability of the single queue, which permits configurability for 
optimal buffer memory space usage. 

A preferred embodiment of the present invention is a "Ferris-Wheel Queue" 
data structure. The "Ferris-Wheel Queue" data structure is a single access point for 
5 the transmission of data on an external point-to-point transmission medium, whose 
data comes from multiple sources. The "Ferris-Wheel Queue" data structure supports 
the buffering of data generated by multiple processes being executed in a single 
multiprocessing system. The multiple processes may each access this queue in an 
interleaving fashion, without the data being combined with data of other processes. 

10 Thus, the single queue approach eliminates the need for multiple queues. A system 
having multiple queues would require one or more queues for each process in the 
system thereby needing buffered data, as well as, the need for supporting the 
functional overhead for each process buffer. 

Generally referring to Figs. 1, 2 and 3, a preferred embodiment of the present 

15 invention is disclosed. There are three major components of the "Ferris-Wheel 
Queue" and subcomponents processes. One subcomponent process is called enque, 
which is the process required to move data into the queue buffer space. Another 
subcomponent process is called deque, which is the process required to move data out 
of the queue buffer space. The "Ferris-Wheel Queue" buffer is the actual memory 

20 storage data structure used to store enque data. 

The enque process is a set of functions which control putting data into the 
"Ferris-Wheel Queue". The enque process provides a set of sub-element functions 
called, write and gethandle. The write function is the main controlling function, and 
gethandle function controls the allocation of space in the queue to multiple processes. 

25 The buffer is a heterogeneous two dimensional array constructed as a circular 

array of specific message structures. The first dimension of the array is a circular 
wheel. The wheel is the portion which contains the seats. The wheel has supporting 
software to support the implementation of a standard circular array. The seats are a 
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collection of message structures which provide a data buffer for each seat, and a set 
of control variables which define the data status of the seat. 

The deque is a set of functions which controls removing data from the "Ferris- 
Wheel Queue". The deque function provides a read function and a senddata function. 
5 The read function is the main controlling function which performs a Round 

Robin search in the first dimension of the buffer and maintains the associated control 
variables of each seat's message structure. The senddata function moves a specified 
amount of particular data to a designated location. 

The enque and deque subcomponent processes are further described herein. 

10 Generally, the enque process (as shown in Figure 2.) includes the steps of enquing 
data into the Ferris- Wheel buffer. First, the enque process determines the number of 
Ferris-Wheel seats required for the data to be enqued 74. Second, it requests the 
required number of seats. If the request is granted then the appropriate number of 
seat handles (indices into the buffer) will be allocated. Third, after the seats have 

15 been allocated, the enque process loads data into each of the seats. Fourth, after all 
data has been loaded into the seats, the process sets the seat control data. Fifth, the 
process provides a ready flag which indicates the message in the seat is ready to 
transmit. Further, the current index into the seat data buffer is set to zero. 

Generally, the deque steps of dequing data from the Ferris-Wheel buffer 

20 include, first, conducting a simple round robin search of the Ferris-Wheel buffers 
checking the control data of each seat in sequence. If the seat is marked ready to 
transmit then the process may continue, otherwise it must be blocked, waiting for the 
next seat to become ready. Second, when a seat is ready the process will read the 
other control data to determine the number of seats belonging to this group of data, 

25 the total size data expected in each seat, and the current index into the seats buffer 
which is used to deque the data from the seat element by element. Third, the seat 
buffer is then dequed and then given to the requesting process. Fourth, the control 
data must be cleared. A ready flag which says the message in the seat is ready to 
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transmit must be set to not-ready. The other flags and values are simply reset to an 
initial state. 

More specifically, referring to Fig. 1, a flow chart 10 depicts the preferred 
embodiment, "Ferris-Wheel Queue" of the present invention. The "Ferris-Wheel 
5 Queue" supports an application layer 11 having a first process 12, a second process 
14, and undetermined number of other processes "n"16. 

Next, the enque process 70 provides the application layer processes with a 
write function (further discussed below) for inserting data messages into the "Ferris- 
Wheel Queue" buffer 18. The buffer 18 includes a first priority buffer (priority 1) 

10 20, and an undetermined number of other subsequent priority buffers (priority "n") 
40. The first priority buffer 20 and the subsequent priority buffers 40 all include data 
boxes 22, 24, 26, 28, and 42, 44, 46, 48, respectively. The data boxes represent 
seats on the Ferris-Wheel buffer. The seat is a special structure which contains a 
local message buffer, and includes control variables. The seats are shown in the 

15 preferred embodiment in Fig. 1 as having number 1, 2, and 3, in boxes 22, 24, 26 
and boxes 42, 44, and 46, respectively. The number in the box represents a handle 
assigned to that particular "Ferris- Wheel" seat which may be allocated to access the 
seat. Thus, seat 42 has a handle "one". The seats having an "n", 28 and 48, 
represent additional boxes as needed and as capabilities allow. 

20 Next, the deque process 120 provides the application layer 49 processes 50, 

52, 54 with a read function (further discussed below) for removing the data messages 
from the "Ferris-Wheel Queue" 10 buffer 18. The application layer 49 includes 
application layer processes 50, 52, and 54. Representing, respectively, a first process 
50, a second process 52, and other processes "n" 54. 

25 More specifically, referring to Fig. 2, a flow chart is shown depicting the 

enque process, which is more specifically disclosed below. The process starts with a 
write command 72 to determine the number of handles required for the data 74. The 
request of handles then requires the program to call to get handles 76. An IF 
statement is generated questioning whether the get handle succeeded 78. IF the 
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answer is no the process returns a Write Failure status 80 and the process is stopped 
82. If the answer to the "get handle" question is yes, the program copies data into the 
allocated seats indexed by returned handles 84. Then, the process returns a 
WriteSuccess status 86. Finally, the process is stopped 88. 

The get handle call 76\of Fig. 2a has a subroutine which is detailed as follows, 
shown in Fig. 2b: The subroutine begins with the get handle command 90 and 
then proceeds to the IF box 92 toNdetermine if there are sufficient handles available in 
the requested priority buffer. If\ufficient handles are not available the program 
returns a Queue Full status and then\he program stops 96. If the answer to the IF 
10 command is yes, that handles are available then the program allocates handles 98, and 
returns a success status to the IF comnWd 78 of flow chart 2a. When this is 
complete, the program stops 100. 

More specifically, referring to Fig. 3, the deque process is disclosed more 
ipecifically below. The deque subVocess begins with a read command 122. The 
program proceeds to continue to chefek the control data of current seat message 
structure 124. An IF command asks if the data is ready (Data Ready) 126. If the 
answer is no, the program returns a QueueEmpty status 128, and then stops the 
program 130. If the answer is yes, the program copies the requested number of data 
elements to the destination or the amount remainW in the local buffer, which ever is 
20 less, and updates the seat local buffer read index 132. 

The next IF command 134 determines whether all elements have been 
transmitted from the local buffer. If the answer is no, the program updates the read 
index of the current local buffer and the control data 136. Next, the program returns 
the number of elements actually copied along with a ReadSuccess status 138. Then, 
25 the program stops 140. If the answer to the IF command 134 is yes, the program 
resets the control data for the current seat and advances to the next Ferris- Wheel seat 
142. Next, the program returns the number of elements actually copies along with a 
Read Success status 138. Then, the program stops 140. 
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The preferred embodiment of the apparatus, and its operation are further 
explained below. As previously discussed, there are three major components of the 
"Ferris-Wheel Queue". The major components are enque, which is the processes 
required to move data into the queue buffer space, deque, which is the process 
5 required to move data out of the queue buffer space and the buffer, which is the 
actual memory storage data structure used to store enqued data. The preferred 
embodiment which uses each of these major components is discussed in detail below. 

The preferred method of enquing data into the Ferris-Wheel buffer is to 
provide a set of software components which will provide the capability of determining 

10 the availability of seats on the Ferris-Wheel and returning a set of one or more 
handles (indices) for the available seats. A mechanism is provided for controlling the 
transport of data into each available seat's buffer space, then setting the appropriate 
seat control information. The main write routine is responsible for controlling the 
enquing process. This routine may be implemented to control one or more "Ferris- 

15 Wheel Queue" buffers each having a different priority, and each being accessible by 
multiple processes. The write routine will need to be passed a pointer to the location 
of the data to be enqued, a priority, if handling multiple priority buffers, and the size 
of the data to enque. The write routine will return the status of the enquing 
operation, for example, "Success", "Queue Full", "Queue Busy", or "Failure". The 

20 write routine determines the number of seat handles required to enque the data by 
dividing the total data size by the size of each seat's buffer. The write routine then 
calls the gethandle routine. This routine may return the required available handles or 
an error status. If no error exists, the write function will call a routine which is 
designed to copy the data from the source location into the appropriate seat buffers. 

25 After the successful loading of the data onto the seats, the write must set the control 
data in each seat. Once set, a "Success" status is returned by the write routine. 

The gethandle routine is implemented to manage handles for one or more 
prioritized "Ferris- Wheel Queue" buffers. The gethandle routine will only return the 
handles if sufficient handles are available to meet the request. If a handle is available, 
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the gethandle routine will then return a "Success" status, otherwise it will return a 
"Queue Full" status. The gethandle routine is the specific control function which 
maintains the available seat handles and appropriately allocates the handles to each 
calling process. This routine is the mechanism which allows multiple processes 
5 operating at various tasks rates to use a single communications buffer without causing 
garbled and intermingled data. This routine is the "Ferris-Wheel Queue's" critical 
section, and must therefore be protected against reentrance issues. 

The preferred embodiment of the Ferris-Wheel buffer is characterized as a 
circular array of message structures. The message structures are a set of control 
10 variables, such as, "Message Ready", "Message Size", "Last Handle", "Read Index"; 
and "Message Buffer". The first dimension of this heterogeneous two dimensional 
array is the circular portion which makes up the wheel of the Ferris-Wheel. On this 
; wheel are located the seats (Message Structures) in the second dimension. The buffer 

may be sized in either/both dimensions in order to achieve optimal memory usage 
] 15 determined by the patterns of data being enqued. This design may include arrays 
i which are statically sized and bound at compile time, or dynamically allocated/sized, 

; which may be sizable arrays at run time. Each seat (message structure) on the Ferris- 

"i Wheel is enumerated by a handle (array index in the first dimension). 

The preferred method of dequing data from the Ferris-Wheel buffer is to 
20 provide a set of software components which will provide the capability of controlling 
the reading of the enqued data and return that data to a lower level transport layer or 
hardware layer driver. The main controlling routine is a read function. The read 
function, when called by a process desiring enqued data, will check the Ferris-Wheel, 
in a round robin search method, for a seat (message structure) which is marked as 
25 ready to transmit. This process will block when it reaches a seat which is not marked 
ready. Upon determining that a seat is ready to be dequed, the read will check all of 
the Message Structure control variables and send data out. The read will deque the 
entire message up to the number of elements requested, that is the smaller of the 
requested size or the message size. The read index in the Message Structure's control 



FIS920000168US1 



13 



variables tells the read function the index of the next element in the Message buffer to 
send. After all of the elements of a seat have been dequed, then the control variables 
are cleared and the seat is marked available again. 

The method of the present invention may be embodied as a computer program 
5 product stored on a program storage device. This program storage device may be 
devised, made and used as a component of a machine utilizing optics, magnetic 
properties and/or electronics to perform the method steps of the present invention. 
Program storage devices include, but are not limited to, magnetic disks or diskettes, 
magnetic tapes, optical disks, Read Only Memory (ROM), floppy disks, 

10 semiconductor chips and the like. A computer readable program code means in 
known source code may be employed to convert the methods described below for use 
on a computer. The computer program or software incorporating the process steps 
and instructions described further below may be stored in any conventional computer, 
for example, that shown in Fig. 4. The computer 150 incorporates a program storage 

15 device 152 and a microprocessor 154. Installed on the program storage device 152 is 
the program code incorporating the method of the present invention, as well as any 
database information for the "Ferris- Wheel Queue" data structure. 

While the present invention has been particularly described, in conjunction 
with a specific preferred embodiment, it is evident that many alternatives, 

20 modifications and variations will be apparent to those skilled in the art in light of the 
foregoing description. It is therefore contemplated that the appended claims will 
embrace any such alternatives, modifications and variations as falling within the true 
scope and spirit of the present invention. 

Thus, having described the invention, what is claimed is: 
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